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HIS REPORT pertains to the sixth major 
fies in a series of investigations de- 
signed to explore abilities considered to be 
important in the successful performance of 
high-level personnel. Previous studies had 
been concentrated on the areas of reasoning 
(Green, Guilford, Christensen, & Comrey, 
1953 ; Guilford, Christensen, Kettner, Green, 
& Hertzka, 1954), creative thinking (Wil- 
son, Guilford, Christensen, & Lewis, 1954), 
and evaluation (Hertzka, Guilford, Chris- 
tensen, & Berger, 1954). The study re- 
ported here was designed to consolidate and 
extend the findings of earlier studies, the 
three main objectives being: (@) verifica- 
tion of factors, some of which had been 
found only once previously; () clarifica- 
tion of the nature of certain factors; and 
(c) derivation of information leading to 
improvement of tests measuring the factors. 


General Plan of the Study 


The following major steps were involved 
in this study, in keeping with others under- 
taken in the project: 

1. Formulation of specific hypotheses 
concerning the factors involved in the area 
of thinking investigated and concerning 


1 Under Contract N6onr-23810 with the Office of 
Naval Research. The ideas expressed in this paper 
are our own and do not necessarily represent the 
opinions of the Office of Naval Research. Repro- 
duction in whole or in part is permitted for any 
purpose of the United States Government. Of the 
authors of this paper, J. P. Guilford is responsible 
investigator and director of the project, Paul R. 
Christensen was assistant director, and Norman 
W. Kettner was in direct charge of this particular 
study, For more detailed information see Guilford, 
Kettner, and Christensen (1954, 1956). 

2 Now with Planning Research Corporation. 

3 Now with System Development Corporation. 


their properties. Only testable hypotheses 
were seriously entertained. 

2. Selection, revision, and construction 
of tests that were believed to be suitable for 
testing the hypotheses. 

3. Administration of the tests to per- 
sonnel homogeneous as to sex and relatively 
homogeneous as to age, education, and gen- 
eral intellectual level. 

4. Factor analysis of the intercorrela- 
tions among the tests. 

5. Revision of original hypotheses, where 
needed, and formulations of new ones. 


Selection of Factors to be Investigated 


In the previous studies in the domains of 
reasoning, creativity, and evaluation, 31 
factors had been found. Eleven of these 
were reference factors, which have not been 
regarded as belonging within these domains. 
Of the remaining 20 factors, 11 were chosen 
for further investigation in this study. The 
selection was determined by several con- 
siderations. The foremost reason for in- 
clusion was the need for further informa- 
tion, particularly where prospects of 
obtaining new information seemed promis- 
ing. Some factors were omitted because 
they were too weak in previous studies to 
be identified. Others were omitted because 
it was planned to investigate them more 
intensively in other studies than would 
have been possible in this one. 

The factors selected from the previous 
reasoning studies were eduction of per- 
ceptual relations, eduction of conceptual 
relations, eduction of conceptual patterns, 
eduction of correlates, and symbol manipu- 
lation. Factors from the creativity study 
were sensitivity to problems, associational 
fiuency, orgimality, and redefinition, Fac- 
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tors from the evaluation study were facility 
with verbal relations and verbal classifica- 
tion. 

In addition, the following reference fac- 
tors were included: general reasoning, 
ideational fluency, logical evaluation, verbal 
comprehension, numerical facility, and 
judgment. 


HypotHrses 
Testing Hypotheses by Factor Analysis 


six of the 11 factors selected for investi- 
gation had appeared in only one previous 
study in this series. These factors necded 
to be verified; they are: eduction of con- 
ceptual patterns, associational fluency, orig- 
imality, sensitivity to problems, facility with 
verbal relations, and verbal classification. 
for each of these factors, in other words, 
the hypothesis that the factor exists was 
being tested. This was done by putting in 
the battery tests that were loaded on the 
factor in a previous study together with 
new and presumably improved tests de- 
signed for the factor, then seeing whether 
the factor would emerge again. 

Other hypotheses concerned the nature of 
each factor. For 8 of the 11 factors alter- 
native hypotheses were formulated. For 
most of the alternative hypotheses at least 
two tests each were constructed with the ex- 
pectations that they would help to make 
decisions between alternatives where that 
is possible. If the tests that were aimed at 
one alternative hypothesis have substantial 
loadings on a factor and the tests aimed 
at a second hypothesis do not, we may de- 
fine the factor as having the properties of 
the first hypothesis. If tests of two or more 
alternative hypotheses are all substantially 
loaded on a factor, the definition would 
need to include all the properties implied. 
Tn some instances, two alternative hy- 
potheses may actually represent two dif- 
ferent common factors, in which case two 
factors would probably replace the one 
formerly recognized. 

Tt will be seen in what follows that in one 
or two instances the same alternative hy- 
pothesis is stated pertaining to two different 
factors. In this case there is suspicion that 


the two factors, previously found in dif- 
ferent analyses, may be one and the same. 
In such cases we were testing whether two 
such factors are, in fact, probably identical. 


Some General Background of the 
fTypotheses 


In general, alternative hypotheses were 
based upon consideration of results of 
previous studies. One alternative hypoth- 
esis for cach factor was based upon the 
latest definition of that factor. Others 
might be other previously tested hypotheses 
that could not be rejected, or previously 
stated hypotheses not herctofore adequately 
tested. Still others represent new thinking 
regarding factors. 

Some of the hypotheses pertain to the 
degree of generality of factors. In our first 
and only acquaintance with the factor of 
sensitivity to problems, for example, the 
ability seemed to be much more restricted 
in scope than had been originally expected. 
The factor had been expected to apply to 
the sensing of almost anything in the en- 
vironment that is unusual, awry, challeng- 
ing, or bothersome. As things turned out, 
it did not reflect anything beyond appreciat~- 
ing defects and deficiencies in mechanical 
and social devices. 

The factor of originality, on the other 
hand, proved to be more general than had 
been expected. Tests requiring diverse 
evidences of originality remained together 
in defining the factor. Some were scored 
for uncommonness or unconventionality of 
responses ; one was scored for cleverness of 
responses; and others were scored for re- 
sponses showing remote associations or 
far-fetched ideas in connection with stimuli. 
Both the sensitivity-to-problems factor and 
the originality factor were being reexamined 
for degree of generality. 

Other hypotheses pertain to the question 
of identity of pairs of factors found in 
different analyses. Associalional fluency, 
found in the creativity analysis (Wilson 
et al., 1954), might be the same factor as 
the one called facility with verbal rela- 
tions found in the evaluation analysis 
(Hertzka et al., 1954). Redefinition showed 
some possibility of identification with the 
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Air Force factor of judgment (Guilford & 
Lacey, 1947) in the creativity analysis but 
failed to show this linkage in the evalua- 
tion analysis. These points needed clarifica- 
tion and were expected to receive some 
clarification in this study. 

Two factors found in the evaluation 
analysis were given special attention in this 
study—facility with verbal relations and 
verbal classification. There was some doubt 
whether these should be regarded as evalu- 
ative abilities at all. The first of these was 
found related to a relatively long list of 
verbal tests. It might even have been identi- 
fied as the factor of verbal comprehension, 
except for the fact that another factor 
qualified for that identification. The lead- 
ing test for facility with verbal relations 
was Controlled Associations, which had 
been included to serve as a marker for the 
factor of associational fluency. The ob- 
tained factor might have been a confound- 
ing of associational fluency with eduction 
of conceptual relations, the latter then re- 
garded as a reasoning ability. In the study 
being reported we should have the oppor- 
tunity to test these different interpretations, 
and, in fact, to see whether the same factor 
would emerge as such a second time. 

There was also doubt as to the status 
of verbal classification. In the first reason- 
ing analysis (Green et al., 1953), we enter- 
tained the hypothesis that there might be a 
separate ability to see identical clements in 
verbal entities. The common observation 
that classes are formed and class concepts 
are born would lend reasonableness to such 
a hypothesis. The hypothesis was proposed 
in connection with a group of ideas about 
inductive reasoning. Not enough classifying 
tests were included in the first reasoning 
analysis to determine whether there is a 
classifying ability distinct from an ability 
to see relations. So far as we know, then, 
both kinds of tests might be loaded with 
the same factor—eduction of conceptual 
relations. Thus, the factor called verbal 
classification in the evaluation analysis 
might have been eduction of conceptual re- 
lations, or it might have represented a new 
factor of ability to classify meaningful 
material. This study was expected to deter- 


mine the status of the classifying-ability 
factor; whether or not it is separate from 
the relations-educing factor. 

A general logical problem arose in this 
study owing to the fact that we introduced 
a number of tests that involved the act of 
naming. In previous studies of tests calling 
for the discovery of relations, patterns, and 
classes, we had generally asked for multiple- 
choice responses indicating that these had 
been discovered from the fact that the 
examinee did something revealing. This is 
an indirect way for the examinee to show 
that he has cognized the relation, pattern, 
or class. The additional step or steps might 
well bring additional common factors into 
the test variances. By asking the cxamince 
to name or describe the rclation, pattern, 
or class, it was thought that we should 
obtain a more direct indication of successful 
cognitions. 

It soon occurred to us that naming, itself, 
is an additional act and might also generate 
additional common factors. Another aspect 
of this problem would be whether, if the 
act of naming does entail something new in 
the way of factors, there would be one new 
naming factor, in common to all of the 
naming tests, or there would be several 
naming factors, each parallel to one of the 
discovery factors—that for discovering per- 
ceptual relations, that for conceptual rela- 
tions, and that for conceptual patterns—and 
perhaps, also, parallel to other factors. Con- 
sidering all the naming tests included in the 
battery, there were possibilities for all the 
way from none to as many as five naming, 
or verbalizing, factors to appear. 


Statement of the [Iypotheses 


1. Eduction of perceptual relations had 
been found in tests composed of figural 
material and not in tests composed of mean- 
ingful words. Two kinds of figural tests 
were involved: those involving seeing 
simple relationships as to form, position, 
shading, and other properties and others 
involving the classification of figures ac- 
cording to their propertics. We therefore 
tested the hypothesis that there is a single 
ability involving both relations and classes 
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of figural material or that there are two 
hypothetical factors: (@) seeing figural re- 
lations and (b) seeing figural classes. A 
hypothesis tested incidentally was whether 
tests involving the grouping of letters and 
spelling of words would also be related to 
one or both factors. 


2. Eduction of conceptual relations had 
had relatively low loadings in previous 
analyses, but there was little doubt of its 
existence as a factor. As in the case of the 
preceding factor, however, there was the 
question of whether one factor would suffice 
ot whether it would take two: (a) seeing 
conceptual relations and (b) seeing con- 
ceptual similarities or seeing classes. 


3. Eduction of conceptual patterns 
seemed to call for something more than 
simple relationships. The term “patterns” 
had been used because it is sufficiently 
general to include principles, systems, rules, 
and perhaps trends. It had been designated 
as “conceptual” at the time this study was 
planned because the patterns were based 
upon combinations of elements in which 
figural properties were of little or no im- 
portance. Three alternative hypotheses 
were entertained in this study: (a) seeing 
patterns, (b) seeing rules or principles, and 
(c) seeing trends. 


4. Eduction of correlates was defined as 
the ability to find something that fits into 
a given relationship. Both conceptual and 
nonconceptual tests had been previously 
loaded on the factor. One important ques- 
tion was whether, if given the opportunity, 
conceptual and nonconceptual tests would 
split into two groups, indicating two dis- 
tinct but parallel abilities, as we had seen 
in a number of places. The leading test for 
the factor previously had included items in- 
volving relations between meanings and 
items involving relations between word 
structure or spelling. In the present study 
the two kinds of items were put in separate 
tests. The two alternative hypotheses were: 
(a) finding something to fit a perceptual 
relationship and (b) finding something to 
fit a conceptual relationship. 

5. Symbol manipulation was defined as 
the ability to manipulate symbols according 


to given rules. In another analysis a factor 
called “symbol substitution” was defined as 
the ability to substitute symbols according 
to rules. We had the question as to whether 
there is one factor or two. With added tests 
included in this study we had the oppor- 
tunity to answer this question and also to 
determine the main properties of either one 
or two factors. The hypotheses were: (a) 
symbol manipulation and (b) symbol sub- 
stitution. 


6. Verbalizing ability was suggested as 
a new factor (or group of factors), in 
accordance with the earlier discussion. We 
had eight tests in the battery that involve 
the naming or describing of discovered re- 
lations, of similarities or identical elements, 
of rules or principles, and of trends. We 
thought that there might be as many as five 
factors and we have accordingly five hy- 
potheses: (a) naming perceptual relations, 
(b) naming conceptual relations, (¢) nam- 
ing classes, (d) stating rules or principles, 
and (e) describing trends. Either c or d 
might divide two ways, depending upon the 
test content, whether figural or verbal. 


7. Sensitivity to problems had been 
found limited to two tests, involving me- 
chanical devices and social institutions, 
respectively, in the creativity analysis. Tests 
were added to determine whether the factor 
generalizes at all to nonmechanical and non- 
social areas. The only hypothesis tested 
here is with regard to the generality of the 
factor. 


8. Associational fluency had been defined 
as the ability to produce words to meet 
specific requirements of meaning. The test 
Controlled Association, which called for 
12 synonymous responses to each item, 
strongly determined this factor in the 
creativity analysis. Another form of the 
same test, which called for only three re- 
sponses to each item, failed to segregate the 
same factor in the evaluation analysis. Both 
forms of the test were included in the pres- 
ent study. We also had two tests that called 
for only one word per item. The two hy- 
potheses were: (a) producing one or two 
words to fit a given meaning and (b) pro- 
ducing several words to fit a given meaning. 
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It might be found that a single factor 
would have both properties or two separate 
factors might be found. 


9. Originality was being tested for de- 
gree of generality, as stated earlier. Orig- 
inality tests had been constructed along 
three lines, involving the production of un- 
common, remote, or clever responses, re- 
spectively. All three kinds of tests had been 
loaded on the factor, but in this study tests 
were added in ways that should have given 
the opportunity for two or even three 
originality factors to emerge. The three 
hypotheses were: (a) production of remote 
responses, (b) production of uncommon re- 
sponses, and (c) production of clever re- 
sponses. 


10. Redefinition had been a rather weak 
factor in two prior analyses. It was defined 
as the ability to shift the function of an 
object or part of an object and use it in a 
new way. In this study we sought to deter- 
mine whether the factor could be verified 
and whether it could be distinguished from 
the judgment factor. As things turned out, 
conditions were not favorable for answering 
the second question. 


11. Facility with verbal relations, as in- 
dicated earlier, was a factor of uncertain 
status. In this study we were merely in- 
terested in determining whether tests pre- 
viously defining the factor would hang 
together as before or whether they would 
define two or more other factors, such as 
associational fluency and eduction of con- 
ceptual relations. 


12. Verbal classification, found in one of 
our previous analyses, offered two logical 
possibilities. The factor was defined as the 
ability to appraise poorly defined verbal 
relationships. Here relation to a category 
or class is actually implied. The “poorly” 
was added because tests of the same charac- 
ter but having more clear-cut, logical rela- 
tionships did not have loadings on the 
factor. An apparently similar factor found 
by Adkins and Lyerly (1951) was defined 
as an ability to perceive abstract similarities. 
The two hypotheses are: (a) appraising 
poorly defined verbal relationships and (b) 
seeing conceptual similarities. 


Summary of the Hypotheses and 
Reference Factors 


For convenience, the various hypotheses 
just stated are presented in outline form to 
serve as ready references in connection with 
later discussion of tests and factors: 


1, Eduction of perceptual relations 
(a) Seeing perceptual relations 
(b) Seeing perceptual similarities 
2. Eduction of conceptual relations 
(a) Seeing conceptual relations 
(b) Seeing conceptual similarities 
3. Eduction of conceptual patterns 
(a) Seeing conceptual patterns 
(6) Sceing rules or principles 
(c) Seeing trends 
4. Eduction of correlates 
(a) Finding something to fit a given perceptual 
relation 
(b) Finding something to fit a given conceptual 
relation 
5. Symbol manipulation 
(a) Symbol manipulation 
(b) Symbol substitution 
6. Verbalizing ability 
(a) Naming perceptual relations 
(b) Naming conceptual relations 
(c) Naming classes 
(d) Stating rules or principles 
(e) Describing trends 
7. Sensitivity to problems 
8. Associational fluency 
(a) Producing one or two words to fit a given 
meaning 
(b) Producing several words to fit a given 
meaning 
9. Originality 
(a) Producing remote responses 
(6) Producing uncommon responses 
(c) Producing clever responses 
10. Redefinition 
11, Facility with verbal relations 
12, Verbal classification 
(a) Appraising poorly defined verbal relations 
(b) Seeing conceptual similarities 


Since many tests designed to test the 
hypotheses were known to contain or were 
suspected of containing common variances 
with factors outside this list, reference tests 
were added to the battery to isolate these 
sources of variance. The reference factors, 
numbered in sequence with those already 
listed, are: 

13. Ideational fluency 
14. General reasoning 
15. Logical evaluation 
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16. Verbal comprehension 
17. Numerical facility 
18. Judgment 


Tue Test Barrery 


The hypotheses were the main considera- 
tion in determining the kinds of tests that 
were selected for inclusion in this study. 
In those cases in which tests had to be 
adapted or new tests had to be constructed 
to fit the hypotheses, several other con- 
siderations were kept in mind. Lach test 
was divided into at least two separately 
timed, comparable parts for purposes of 
convenient and meaningful estimation of 
reliability. Variance due to personal ex- 
periences of examinecs was minimized as 
much as possible. An attempt was made to 
keep the factorial complexity of tests as 
low as possible. Before the assembly of the 
battery, new or adapted tests were pretested 
on samples of college students. On the 
basis of these results, 57 experimental tests 
were selected for inclusion in the analysis. 
It had been planned to include several of 
the Air Force tests, which are given to air 
cadets routinely for classification purposes, 
to serve as markers for some of the ref- 
erence factors. But by the time our battery 
could be administered, the Air I*orce had 
discontinued separate scoring of its classi- 
fication tests, hence the test scores were not 
available to us. 

The tests are described in the following 
section. For convenience the tests are listed 
in alphabetical order. I’or every test the 
nature of the task is described and for most 
a sample item is given. Other information 
includes the number of separately timed 
parts, the number of items per part, and 
the working time. The code numbers of 
the tests indicate the following information. 
The first letter, R, C, I, or P, indicates 
reasoning, creativity, evaluation, or plan- 
ning, respectively. The second letter (or 
pair of letters) stands for a specific hypoth- 
esis. Next comes the number of the test 
in that category, 01, 02, etc. The last letter 
indicates the form of the test, A meaning 
the first form, B the second, and so on. The 
uncoded tests were taken over from bat- 


teries given before the coding system was 
instituted. 


Description of Tests* 


1. Apparatus Test—CS01B. A list of 20 imple- 
ments is presented. The E’s (examince’s) task is 
to suggest two improvements for each of them. 
Sample item: 

Suggest two improvements for the telephone. 

1. A device to record messages when no one is at 
home. 

2. Luminous dials to operate in the dark. 

Parts, 2. Items per part, 10, Working time, 14 min. 

hfe,® 7. 

2. Associations III—CNO5A, The items consist 
of pairs of words. The E’s task is to think of a 
single word that is similar in meaning to both the 
given words. Since the given words are not 
synonyms, the word that Z supplies must have a 
different meaning in relation to cach of the given 
words. 

Sample item: 
recline — lie deceive 

The correct answer is “lie” since it has a mean- 
ing similar to both given words. 

Parts, 2. Items per part, 15, Working time, 12 min. 
hfe, 8a, 9a, 11. 


3. Associations IV—CNO6A. This test is made 
up of pairs of words like those in Associations III. 
Jn this test, however, /:’s task is to think of a word 
that is associated with (not synonymous with) the 
given words and that has a different meaning in 
its relation to cach of the given words. 


Sample item: 


jewelry bell 


A correct association word is “ring.” It has a 
different meaning in its relation to each of the 
given words. It is a piece of jewelry and also the 
sound of a bell. 


ring 


* The authors gratefully acknowledge permission 
for test use and/or adaptation granted by the 
following authors or publishers: D, C. Adkins and 
D. E. Baier (Tests 31 and 56) ; R. J, Blakey (Tests 
5 and 18); L. L. Thurstone (Tests 9, 10, 23, and 
51); National Council for Social Studies (Test 
12); and the Ronald Press Company (Test 25). 
Tests 13 and 44 were developed by the U. S. Air 
Force and Test 17 was developed by the U. S. 
Navy. Acknowledgment is also made for per- 
mission granted by the Saturday Lvening Post 
and Collier’s to use their cartoons in Test 4. We 
also wish to thank Constance D. Lovell for making 
available io us a number of classes in beginning 
psychology for preliminary experimental testing. 


5 hfe stands for hypothesized factor content. See 
preceding summary for key to the hypotheses. 
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Parts, 2. Items per part, 15. Working time, 14 min, 
hfc, 9c. 


4. Cartoons—CN07A. Each item is a cartoon 
taken from old issues of Saturday Fivening Post 
or Collier's. The £’s task is to supply clever 
“punch” lines for each of the cartoons. 

Parts, 2. Items per part, 8. Working time, 14 min. 
hfe, 9c. 


5. Circle Reasoning (no code number). Each 
item consists of five rows of circles and dashes. 
One of the circles in each of the first four rows 
has been blackened according to a rule. The L’s 
task is to find the rule and then mark the circle 
that should be blackened in the last row. 


Sample item: 





The second circle from the left in each row 
should be black; therefore, the second circle in the 
last row is marked to indicate that it is the one 
which should be black. 

Parts, 1. Items per part, 15, Working time, 8 min. 
hfe, 3a. 

6. Completion of Figural Changes—RECO5A. 
In each item a figure is given, Written instructions 
as to how the figure changes are also given. The 
E's task is to draw a figure that shows the results 
of all the changes. 

Sample item: 









Change the circle to a square. 
Add a cross to the inside, 





Jf£ the circle is changed to a square and a cross 
is put into the square, then the figure that is drawn 
at the right is the correct answer. 

Parts, 2. Items per part, 10. Working time, 10 min, 
hfe, 4a, 


7. Consequences Test—CF06A (low-quality 
score), The £ is to write what would happen if 
certain changes were suddenly to take place. He is 
to list as many different consequences or results of 
these changes as he can. 

Sample item: 

What would happen if all national and local laws 

were suddenly abolished? 

1. No more parking tickets 

2. There would be more killing. 
3. No more taxes 

Two scores are derived from this test. The low- 
quality score is the number of direct responses, i.e., 
those responses that describe direct or immediate 
consequences of the given changes, 


Parts, 4. Ttems per part, 1. Working time, 8 min. 
hfe, 13. 


8. Consequences Test—CFO06A (remoteness 
score). The remoteness score is the second score 
that is derived from the Consequences Test. It is 
the number of remote responses, i.c., those re- 
sponses that describe remote or far-reaching con- 
sequences of the given changes. 

Parts, 4. Items per part, 1. Working time, 8 min. 
hfe, 9a. 

9. Controlled Associations—CAFO1B. In each 
item E is given a common word. His task is to 
write as many synonyms as possible for cach word, 
12 spaces being provided for cach word. 


Sample item: 


GOOD: right virtuous deserving 
excellent noble pleasing 

Superior worthy creditable 

commendable pious admirable 


Parts, 2. ltems per part, 4. Working time, 14 min. 
hfe, 8d. 


10. Controlled Associations II—CAFO02B, The 
format of this test is the same as Controlled Asso- 
ciations, CAF01B, except that E may give only 
three synonyms for cach given word. 

Sample item: 

ODD: unusual 
unique 
queer 
Parts, 2. Items per part, 10. Working time, 6 min. 
hfc, 8a, 8b, 11. 


11. Correlate Completion II—RECO1A. Each 
item consists of two pairs of words and a single 
word. The E’s task is to supply a word that bears 
the same relation to the single word as the relation 
between the words in the first two pairs. The rela- 
tion between the words in each pair is based on the 
structure of the words and not on their meanings. 


Sample items: 


1. am ma not ton tool loot 





2. enrage correlate late about bout 


Parts, 2. Items per part, 20. Working time, 12 min. 
hfe, 4a. 


12. Critical Evaluation—ELO5A. The state- 
ments of this test have been taken from the section 
of newspapers entitled “Letters to the Editor.” It 
is E’s task to designate those statements (A) based 
primarily on emotion or prejudice, and those (B) 
showing reasoning and thought. 


rage 


Sample items: 

1. All people who drink hard liquor should have 
their driver’s licenses taken away. 

2. The police should revoke the licenses of those 
people who drive while drunk. 

Answers: 1, A, 2. B. 

Parts, 2. Items per part, 15. Working time, 5 min. 

hfe, 12a. 
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13. Figure Analogies—RPRO4A. The E’s task 
is to select a figure that bears the same relation to 
the third figure as the second bears to the first. 


ne item: 


Oe. CS Sea 


Answer: 








Parts, 2. ae per part, 15. Working time, 10 min. 
lifc, la, 4a. 


14. Figure Analogies Completion (no code num- 
ber). This test is the same as Vigure Analogies 
RPRO4A except that E must draw the figure that 
completes the second pair in accordance with the 
relation given by the first pair. 

Sample item: 


Parts, 1. Items per part, 15. Working time, 10 min. 
hfe, 4a. 


15. Figure Classification—EFO01A. Classes are 
defined by groups of three figures. Single figures 
have to be assigned to these classes in terms of 
common characteristics. There are three sets of 
five classes and five single figures have to be classi- 


fied for each sect. 


Sample item: 


r — A 
xr @ #£#® 


Answer: L-B, IL- A. 
Parts, 1. Items per part, 15. Working time, 6 min. 
hfe, 1b. 


16. Figure Matching—EF04A. In each item a 
geometrical figure is given along with a set of 
five other figures. The &’s task is to select the 
figure from the set that has most in common with 
the key figure. 

Sample item: 





[iss ss Al 

| [dal foe} -))C 
A B c D E 

Answer: 


Parts, 2. Items per part, 15. Working time, 14 min. 
hfe, 10. 


17, Figure Matrix (no code number). In each 
item nine squares are presented with figures that 
change in both directions. Some squares are left 


empty. The E indicates which onc of five alternate 
figures goes in an indicated square. 


Sample item: 





Answer: E. 


Parts, 1. Items per part, 15. Working time, 7 min. 
hfe, la. 


18. Form Reasoning (no code number), In each 
item three familiar forms are given. In addition, 
a table showing how these forms can be combined 
is given. On the basis of this table, J is to find a 
form that is equal to the three given forms. 


Table: 






Sample iten.: 


wOw 


The answer 1s found in the following manner. 
According to the table above, the first two figures— 
that is, the star and circle—are equal to a square. 
Now, if a square is put in place of the star and 
circle, then a square and a cross remain. Accord- 
ing to the table a square and a cross are equal to 
a triangle. Therefore, the correct answer is a 
triangle. 


Parts, 1. 
hfe, 5d. 


Ttems per part, 20. Working time, 2 min. 


19. Gestalt Transformation—-CR03A. In each 
item a problem is presented. The F’s task is to 
select from five given objects the one that would 
be most useful in solving the problem. 


TO START A FIRE 


A. fountain pen B. onion C. pocket watch D. light 
bulb E. bowling ball 


Best answer: C. 


Sample item: 


Parts, 2. Items per part, 10. Working time, 10 min. 
hfe, 10. 
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20. Inference Test—RDO3B. lach item presents 
a statement of fact or opinion, such as might be 
found in a newspaper, and five alternate con- 
clusions. The £& indicates which of these can be 
drawn with most justification. 

Sample item: 
Most of the trees in the forest are green. 
A, There are no yellow trees in the forest. 
B. There are some yellow trees in the forest. 
C. Some of the trees in the forest are green, 
D. Green trees are the tallest in the forest. 
FE. Pine trees are green. 
Answer: C, 
Parts, 2. Items per part, 8. Working time, 10 min. 
hfe, 15, 


21. Inventive Verbal Relations—RECO7A. In 
cach item a different relationship is stated. Two 
words are then given. The /’s task is to produce 
two words that bear the specified relationship to 
the given words. 

Sample item: 
(a) is the opposite of (b) 
(a) black: (b) white :: (a) strong: (b) weak 


Parts, 2. Items per part, 15. Working time, 8 min. 
hfe, 4b. 


22. Letter Grouping—RPSO1A. In cach item 
four groups of four letters each are given. Threc 
of the groups are alike in some way. The £’s task 
is to pick out the group of letters that is different 
from the other three. 

Sample item: 


AABC ACAD ACFH AACG 
== Eocene t] 
Parts, 2. Ttems per part, 20. Working time, 8 min. 


hfe, 1d. 


23. Letter Series—RCPO03A. Each item consists 
of a series of letters. The #’s task is to find the 
rule for the series and write the next two letters 
in the series. 














Sample item: 


—E F E F E F E F E 


Parts, 2. Items per part, 15. Working time, 8 min. 
hfe, 3b, 


24. Letter Triangle—RCPOIB,. Each item con- 
sists of a series of letters arranged in triangular 
form with various letters left out. The E’s task 
is to determine which letter goes into the blank 
space indicated by the question mark. 


Sample item: 


a A. h 

boc Be j 
def Cg 

? D. f 
ee ad aa Cr 


Answer: C. 
Parts, 2. Items per part, 8. Working time, 12 min. 


hfe. 3a. 


25. Logical Classification—ELO7A. This test 
consists of statements containing “ought.” The £ 
has to classify these statements in terms of cate- 
gories, which are defined and for which examples 
are given. 

Sample item: 

You ought not to cross the street against the red 
light. 

A. custom B. completeness C. safety D. utility 

LE. welfare 
Answer: C, 
Parts, 2. Items per part, 25. Working time, 14 min. 
hfe, 10, 11, 15. 


26. Matrix Order—PROIA, Fach item consists 
of a 3 X 3 matrix of words, The £’s task is to 
draw a straight line through three words that 
represent a sequence in space or time, He is also 
to indicate the direction of the sequence by arrow 
heads. 


Sample items: 






A. run think want 
read ite sleep 
walk pyblish book 

B. tank cloth 
accident i flare 





mixmaster valley 


Parts, 2. Items per part, 15. Working time, 18 min. 
hfe, 3c. 

27. Number Series—RCPO05A. In each item a 
series of numbers is given. The /’s task is to find 
the rule for the series and write a description of 
it in the given blank, 

Sample item: 
15 18 21 24 27 30 +3 


Parts, 2. Items per part, 20. Working time, 12 min. 
hfe, 3b, 6d. 


28. Object Synthesis—CYOIB. In each item the 
names of two objects are given, The /:’s task is 
to think of something that could be made by 
combining the two objects. 
Sample item: 

GIVEN: volley ball 

Possible answer: punching bag. 

Parts, 2. Items per part, 12. Working time, 10 min, 
hfe, 10. 

29. Perceptual Relations Naming—RPRO3A. In 
cach item two pairs of figures are given. The £’s 
task is 1o state the relation that the first figure of 
each pair bears to the second. 


steel spring 


Sample item: 


a A o) J\ 


@ Oo) C) = 


Parts, 2. Items per part, 14. Working time, 14 min. 
hfe, la, 6a. 
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30, Picture Classification—EF03A. Classes are 
defined by groups of three pictures each. The £’s 
task is to assign single pictures to these classes in 
terms of common characteristics. 


Sample item: 

















Answers: I - B, 11 - A. 


Parts, 2. Items per part, 15. Working time, 13 min. 
hfe, 2b, 12b. 


31, Picture-Group Naming—RCS03A. Tach 
item is a group of five pictures of objects that 
are alike in some way. The L’s task is to provide 
a class name for cach group. 


Sample item: 





Parts, 1. ltems per part, 24. Working time, 6 min. 
hfe, 2b, 6c, 120. 


32. Plot Titles—CF02C (cleverness score). In 
the Plot Titles test, four story plots are presented. 
The £ is instructed to write as many clever titles 
as he can for each plot. The cleverness score is 
the number of responses that are rated clever. 


Parts, 4. Items per part, 1. Working time, 12 min. 
hfe, 9¢ 


33. Plot Titles—CF02C (low-quality score). 
The low-quality score is the number of responses 
that are rated “not clever.” 


Parts, 4. Items per part, 1. Working time, 12 min. 
hfe, 13, 


34. Prescribed Relations—RSMO03B. In each 
item one figure is given, Written instructions as to 
how the figure is to be changed are also given. 
The E’s task is to pick out from five given alter- 
natives the figure that shows the results of all the 
Sample item: 


6 mice 


Answer: Ce A 7 c 


Cirele changes to square 
Cross 19 added to inside 




















Parts, 2. Items per part, 10. Working time, 10 min. 
hfc, 4a. 


35. Quick Response-—CNO1A. This test re- 
sembles the conventional word-association test. A 
list of words is read to the examinees at the rate 
of one every five seconds. The E is instructed to 
write down the first word that comes 1o him. 


The test is scored by assigning a weight to each 
response where weights are directly proportional 
to infrequency of occurrence in the population, and 
summing the weights. 


Parts, 1. Items per part, 50, Working time, 4.2 min. 
hfe, 9b. 


36. Remote Verbal Similaritiese—RCS02B. In 
this test Z’s task is 1o select a word from five 
alternatives that has most in common with a given 
word, where all connections are rather remote. 


Sample item: 
FATHER A. candidate 
3B. second baseman 
C. agitator 
TD, superintendent 


le. salesman 
Answer: D. 


Parts, 2. Items per part, 15. Working time, 10 min. 
hfc, 9a, 12a. 


37. Seeing Deficiencies—PJO1A, In each item 
a short description of a plan or activity is given. 
The £’s task is to point out how the plan is faulty. 


Sample item: 


A. growing city discovers pressing needs to im- 
prove both its strects and its sewer systems. After 
due consideration, the council decides to work on 
the street-improvement program first. What is 
wrong with this plan? 

The streets will have to be torn up again for the 
sewer system, 








Parts, 2. Items per part, 10. Working time, 20 min, 
hfc, 7. 


38. Seeing Problems—CS06A, In each item the 
name of a common object is given. The /:’s task 
is to write down five problems that might arise in 
connection with the object. 


Sample item: 
CANDLE: A. How to light it. 
B. Keeping it from falling. 
C. Keeping it from flickering. 
D. How long will it burn. 
EK. What to do with the drippings. 

















Parts, 2. Items per part, 6. Working time, 8 min. 
hfe, 7, 13. 


39. Seemg Trends—RIO6A. The items in this 
test consist of a group of words that tend to change 
progressively in some meaningful way. The £’s 
task is to discover the trend in the words. 
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Sample item: 
Mouse rat lion pig cow 
Animals become larger. 


horse elephant 





Parts, 2. Items per part, 10. Working time, 10 min. 
hfe, 3c, 6e. 


40. Seeing Trends II—RCP04A, This test is 
similar to Seeing Trends RIO6A. Each iiem con- 
sists of a group of words and H’s task is to find 
the trend in the words. In this test, however, the 
trend is based on the structure of the words rather 
than on the meaning of the words, 

Sample item: 

Anger — bacteria 

The first letters go from 


camel dead excite 


699 693 


a’ to “e 





Parts, 2. Items per part, 12. Working time, 16 min. 
hfc, 3c, 6e. 


41. Ship Destination (no code number). Using 
a diagram and observing an increasing number of 
rules, 12 has to determine the distance between ships 
and ports. In addition to rules of distance, wind 
direction must be considered at the start of the 
test. Later the current direction, the strength of 
wind and current, and the heading of the ship must 
all be taken into account, 

Parts, 1. Items per part, 48. Working time, 15 min. 
hfe, 14. 


42. Sign Changes—CX04B, This test involves 
simple numerical operations in which 2 must sub- 
stitute one arithmetic operation sign for another 
before performing the operation, 

Sample item: 
In the following problems wherever you see: 
— replace it by x 
+ replace it by — 
3-6= 18 
6425 4 
Parts, 3. ltems per part, 8, 16, 16, Working time, 
1.67 min. hfe, 5d. 


43. Sign Changes I-—RSM02A. The items 
consist of simple arithmetic equations. In these 
equations the value on the left of the “equals” 
sign is not equal to the value on the right. The 
fi’s task is to indicate which interchange of signs 
will make the two values equal. 


Sample item: 


1+2=4x1 A, + and — 
B. X and + 
C. + and + 
D. X and + 
i. Xx and — 
Answer: E. 
Parts, 2, ltems per part, 10. Working time, 14 min. 
hfc, 5a. 


44. Similarities—RCSO1A, Each item consists 
of a pair of common objects. The /’s task is to 
write six ways in which the objects are alike. 


Sample item: 
Apple and Orange are alike 


. sweet 





round 





have seeds 
fruit 
I. grow on trees 





7D OS 








I) have skins 





Parts, 2. Items per part, 6. Working time, 10 min. 
hfe, 2b, 12b, 13. 


45. Social Institutions—CSO5A. In each item 
the name of a social institution is given. The E 
is asked to list two improvements for cach social 
institution that is given. 


Sample item: 
Marriage: 
Courses on marriage in schools. 





Social approval of women proposing. 





Parts, 2. Items per part, 6. Working time, 10 min, 
hfe, 7. 


46. Syllogisms I—ELO1A. The items in this 
test represent 15 combinations of the four figures 
and four moods of the categorical syllogism. The 
£ is required to state whether the conclusion is 
true or false in each case, 

Sample item: 
All soldiers are men. 
Some citizens are soldiers. 
Therefore, some citizens are men. 
Answer: True. 
Parts, 2. Items per part, 15. Working time, 10 min. 
hfe, 15. 


47. Symbol Manipulation IT—RSM04A. In 
each item a main statement, presented symbolically, 
is given along with several conclusions. Each con- 
clusion consists of two parts. The E’s task is to 
indicate the truth or falsity of each conclusion on 
the basis of given definitions of the symbols. 
Sample item: 

“L” means “larger than’ 
“S” means “smaller than” 
“E” means “equal to” 
“NE” means “not equal to” 

Tf xy and yNIEz, then: 

1. xNEz and yI'x 

2. xSz and xz 


A. Both parts are true. 

B. One part is true and the other part is indeter- 
minate. 

C. One part is true and the other part is false. 

D. One part is false and the other part is indeter- 
minate. 

i, Both parts are false, 


Answers: 1 - A, 2-C. 
Parts, 2, Items per part, 15. Working time, 10 min. 
hf{c, Sa, 15. 
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48. Unusual Uses—CNO04B. The items are 
names of common objects. Each object has a 
common use, which is given. The £ is asked to 
list other uses for which the object or parts of the 
object could serve. 

Sample iten:: 
A newspaper (used for reading) 
. to start a fire. 





1 

2. to wrap garbage in. 

3. to swat flies, , ¥ 
Koes 
5 








; stuffing to pack boxes. 





to line drawers or shelves. 
6. lo make up @ kidnap note. 








Parts, 2. Ttems per part, 3. Working time, 10 min. 
hfe, 9, 13. 

49, Verbal Analogies I~RCROIC. This is a 
verbal-analogies test in which there was an attempt 
to make the relationship between the first pair of 
words relatively difficult to grasp and the analogy 
relatively easy to fulfill, 
Sample item : 

electricity: energy green: ? 
A. color B. red C. grass D. trees EX. foliage 
Answer: A. 
Parts, 2. Ttems per part, 15. Working time, 12 min. 
life, 2a, 

50. Verbal Analogies Completion—RICO8A. 
This is a completion form of the verbal-analogies 
test. 

Sample item: 


cloth: «dye house: paint 





Parts, 2. Items per part, 25. Working time, 8 min. 
life, 4b. 


51, Verbal Classification—EL16A. Vertical 
groups of cight words are flanked on either side 
by vertical groups of four words that define two 
classes. After deciding upon the nature of the 
defined classes, /! goes down the center column 
of words, checking on the Ieft if a word belongs in 
the class to the left, checking on the right if it 
belongs in the one on the right, and making no 
mark if the word does not belong in either class. 


Sample item: 














COW ____desk Vv TABLE 
HORSE Vs sheep = ss CH ATR 
GOAT rocker Y_. BOOKCASE 
DOG tree LAMP 
Vv cat 
nose . 
dresser VV 


re. a donkey = ee 
Parts, 2. Items per part, 40 (5 groups of 8). 
Working time, 8 min, hfe, 2b, 128, 


52. Verbal Comprehension (no code number). 
This test is Part [ of the Guilford-Zimmerman 
Aptitude Survey (short form). It is a standard 
multiple-choice vocabulary test. 


Parts, 1. Items per part, 40. Working time, 12 min. 
hfe, 16. 


53. Verbal Relattons Naming—RCRO2A. Mach 
item consists of two pairs of words. The L:’s task 
is to write down the relation that the first word in 
each pair bears to the second. 


Sample item: 
(a) dwarf (b) giant 
(a) bottle (b) barrel 
Parts, 2. Items per part, 25. Working time, 12 min. 
hfc, 2a, 60. 

54. Vocabulary Completion—RECO6A. The E’s 


task is to write down a word that fits a given 
definition and that begins with a given Ictter, 


Sample item: 
A contest of speed.......... (r) 


(a) ts smaller than (b) 


race 
Parts, 2. Items per part, 40. Working time, 6 min. 
hfc, 8a, 16. 


55. Word Classification—-EL17A. The E’s task 
is to decide which word in a group of four does 
not belong. 


Sample item: 

A. horse 
Answer: Db, 
Parts, 2. Jiems per part, 20. Working time, 14 min. 
hfc, 2b, 126, 


56. Word-Group Naming—RCS02R. Each item 
consists of groups of five words. The /’s task is 
to write down a definitive name for cach group of 
words. 


Sample item: 
knife pan 


B. cow C. man D, flower 


bowl strainer 


cooking utensils 


rolling pin 





Parts, 2. Ttems per part, 15. Working time, 10 min. 
life, 2b, 6c, 12b. 

57. Word Groups—RPS02A, Each item consists 
of a group of four words. The £’s task is to find 
out what the words in each group have in common, 
The things that the words have in common are 
structural rather than meaningful. 

Sample item: 
restless 


retire rearming 


All words begin with “re? 


read 


Parts, 2. ltems per part, 15. Working time, 20 min. 
hfe, 1b, 3b, 6c. 





TESTING CONDITIONS 


It had been originally planned that this 
battery of tests would be administered to a 
single sample. Arrangements had been 
made in December of 1953 to administer 
the battery to aircrew trainees at Lackland 
Air Force Base, San Antonio, Texas. The 
total testing time amounted to 12 hours. 
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During the interval between the time the 
arrangements were made and the test mate- 
rial was shipped, conditions had changed at 
Lackland Air Force Base. Twelve hours 
of testing time could not be worked into 
the schedule of the trainees and a maximum 
of six hours was offered. The solution was 
to divide the battery into three smaller ones, 
Batteries A, B, and C, each taking six 
hours. It was later learned that the Air 
Force could not work Battery B into its 
schedule so arrangements were made to 
have it administered to naval air cadets at 
Pensacola, Florida. 

An overlapping of the batteries enabled 
us still to test most of the hypotheses, al- 
though with some loss of information. 
There was something gained by the fact 
that some factors could come out in more 
than one analysis, hence there was some op- 
portunity for replication of results. Two 
tests, Nos. 20 and 46, had to be omitted 
entirely, which meant loss of two tests for 
the factor of logical evaluation. 


Test Administration 


In setting up the batteries, special attention was 
given to the order of administration of the tests, 
seeing that the tests designed for a certain hypothe- 
sis were not given consecutively. Administration 
manuals provided complete information to test ad- 
ministrators, From both testing locations it was 
reported that no special problems arose during the 
test administration and that the examinees seemed 
well motivated. 


The Samples 


Batteries A and C were administered at Lackland 
Air Force Base to 205 and 215 aircrew trainees, 
respectively, in groups of approximatcly 100 each, 
during the month of August, 1954. Battery B was 
administered {o 225 examinees in groups of 30 to 
60 every two weeks during the months of October 
through December, 1954.6 At both locations the 


"Grateful acknowledgment is made to the Per- 
somel Research Laboratory, HRRC, Lackland 
AFB, Texas, and to the Aviation Psychology 
Laboratory, U. S. Naval Air Station, Pensacola, 
florida, for making this testing possible. In par- 
ticular, the authors wish to thank Lloyd G. 
Humphreys and J. W. Bowles at Lackland and 
Wilse B. Webb at Pensacola. In addition, the 
authors wish to thank the military and civilian 
personnel who acted as test administrators and 
proctors. 


aviation cadets were typically in their early 20’s, 
above the average of the population as to general 
intelligence, and had education of the level of high- 
school graduation or beyond. 

Some of the examinces had to he eliminated from 
the study because of incomplete information re- 
garding them. As a result, the samples numbered 
201 for Battery A, 219 for Battery B, and 210 for 
Battery C. 


TREATMENT OF TITE DaTa 


Scoring 


The responses to 20 of the tests were recorded 
on IBM answer shects by the examinees. The 
answer sheets were machine scored and the scoring 
checked. All scores involved a correction for guess- 
ing. The remaining tests being of completion form 
were scored by hand and the scoring checked. 


Test Statistics 


Reliabilities were estimated using a sample of 
200. Alternate forms and odd-even estimates were 
made for 49 of the tests. For two tests the Kuder- 
Richardson Formula 20 was used, Other esti- 
mates were obtained from earlier studies. The 
various estimates of reliability and their sources 
are given in Table A,’ along with means and 
standard devialions of the various test variables. 


The lactor-Analysis Procedures 


After checking upon score distributions, which 
all approached the normal form, Pearson product- 
moment correlation coefficients were computed 
among the tests for the three batteries. These data 
are presented in Tables B, C, and D. 

Twelve factors were extracted from each of the 
correlation matrices, using Thurstone’s complete 
centroid method. The loadings of the last centroid 
factors were all smaller than .20 in absolute value 
and all residuals were lIcss than .05 in absolute 
value. The unrotated factor matrices are presented 
in Tables E, F, and G. 

The axes were rotated by Zimmerman’s (1946) 
graphic, orthogonal method. The three criteria 
used to guide the rotations were simple structure, 
positive manifold, and psychological meaning ful- 
ness. The rotated factor matrices are presented in 
Tables 1, 2, and 3. 


7 Tables hereinafter designated Tables A-G have 
been deposited with the American Documentation 
Institute. Order Document No. 5958 from ADI 
Auxiliary Publications Project, Photoduplication 
Service, Library of Congress, Washington 25, 
D. C., remitting in advance $1.25 for microfilm or 
$1.25 for photocopies. Make checks payable to 
Chief, Photoduplication Service, Library of Con- 
gress. 
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TABLE 1 
RotatEp Facror MATRIX—BATTERY A 

A B Cc i Yr G H J K M U 

Vv GR PR CR ve EP EC SM SS CC (d) Ri h? 
5. ~.01 08 14 13 08 44 23 01 —.06 09 —.01 .28 .39 
6. 29 10 40 12 05 15 31 18 17 17 28 .09 57 
11. 04. 17 11 17 24 25 42 17 17 31 19 .05 56 
12. 39 18 -—.09 06 10 03 —.02 —.04 29 04 -.01 227 37 
13. 18 27 54 16 15 .29 25 07 08 —.02 05 14 63 
14, 12 18 33 17° —.01 .07 53 —.02 —.02 —.03 26 19 58 
16, 13 ~—.12 00 ~—.10 13 .26 04 —.12 14 02 09 .28 225 
17. 12 19 39 ~.03 13 27. ~—.01 03) —.10 14 09 .10 34 
18. 01 25 20 15 ~—.08 .16 08 02 53 07) —.04 .03 45 
he 41 09 14 23 12 11 18 14 23 51 13 04 66 
23. 08 41 14. 15 18 36 40 15 14 27 00 04 66 
24, 11 08 17 20 ~.02 38 33 26 02 09 07 .03 42 
26. 42 02 05 03 10 .08 21 19 —.04 20 07 .10 33 
27. 02 36 11 04 22 32 16 43 32 20 —.03 15 .67 
29, 03 29 45 13 11 oA 31 09 16 30 01 07 257 
30, 28 ~—.05 28 37 15 17 225 20 09 00 —.06 . 20 .50 
34, 07 26 27 29 21 14 12 20 07 OL 41 .08 53 
39, 17 10 —.04 19 00 J2t 08 —.06 05 29 59 .00 57 
40. 09 11 10 29 24 Al 31 12 26 28 14 17 .49 
41. 04 61 06 18 00 .07 20 07 03 06 O1 03 46 
42. 08 22 ~.01 12 ~—.01 ~—.01 21 19 65 05 04 26 64 
43, —.06 37 11 14 06 .07 28 39 09 07 21 .06 47 
47, 08 23 16 13 24. .08 12 43 08 10 26 .07 45 
49, 49 23 16 48 Ot ~.02 ai 13 02 04: 19 21 .69 
50. 38 12 28 38 29 .16 13 02. —.05 35 15 .00 . 66 
51. 14 21 13 30 32 .09 14 06 07 29 19 £05 43 
53. 28 19 24 29 04 .16 13 18 11 54 01 .09 04 
55. 42 09 04 20 45 ~—.01 28 03 05 05 09 26 .59 
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TABLE 2 
Rotatrp Facror Matrix—Battery B 
A Cc D E F I Is M P 

Vv PR Pc CR VC SR NA cc AF Re Rs; Ry h? 

2 31 12 .09 04 19 16 .20 18 46 20 01 —.04 51 
3. 12 11 20 13 16 —.09 17 02 40 21 270 —.15 45 
10. 28 04 05 16 27 12 14 03 48 ~—.13 .00 .05 AT 
it. 14 20 25 22 10 .50 .06 44 27 —.01 .06 .03 74 
12. .37 ,06 12 14 —.01 12 .28 —.07 11 —.10 .19 09 34 
13, .10 58 18 .28 05 21 .18 19 —.04 —.11 .08 —.16 .62 
15. .18 .30 37 04 10 00 06 14 14 —.05 13 04 £33 
16, .08 28 17 .00 12 14 —.10 .07 00 -—.28 06 —.13 .26 
17, 17 55 13 —.02 —.08 17 13 07 —.04 04 .03 11 42 
21. .53 .08 19 05 11 04 .29 47 20 —.08 24 .00 vhs) 
22. .07 225 29 07 17 .56 27 14 24 —,12 03 —.05 67 
29, .29 19 06 —.07 15 .39 .22 34. —.01 00 .02 —.08 47 
30. 215 02 40 24. 10 24 22 —.09 08 06 15 —.05 40 
31. 12 .08 33 .05 07 .08 .38 21 15 —.01 15 215 .40 
36, 32 715 25 .09 12 —.05 01 —.05 14 —.02 .29 .08 033 
39, .29 .03 07° —.03 19 14 34 .00 02 —.08 .20 —.07 31 
40, .20 15 04 15 17 42 -08 .19 23 —.03 .09 12 AL 
49, .39 14 28 43 13 28 .00 07 —.09 —.05 08 --.01 235 
50. 43 .22 09 37 15 -08 22 41 17. —.05 04 —.05 .66 
51. 20 .23 18 34 40 04 .19 20 18 —.02 .02 .03 51 
52. 79 .05 O1 15 08 12) —.03 11 10 —.19 .05 .09 74 
53. 28 12 04 .10 28 18 .32 33 16 —.02 11 .20 .50 
54. .40 .09 20 11 16 .20 +23 44 41 04 12 —.06 72 
55. 39 .00 29 20 40 .09 —.10 13 00 05 21 —.01 52 
56. 3l .07 17 29 38 04 36 13 00 —.12 05 —~.02 52 
57. 22 11 28 22 29 38 —.09 19 27 12 09 —.17 58 
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TABLE 3 
RoTaTep Factor MAtTRIx—BAtTTERY C 

A I L N oO P Q R S T 

Vv SR NA SP Pe AF oO Re Ir Sx Rs Re h? 
1. —.11 03 05 45 51 20 17° —.03 24 22 01 .03 65 
2. 42 00 21 —.05 —.09 .36 12 35 —.08 20 12 .20 .60 
3. 29 15 24 —.06 —~.08 47 .02 24 00 —.04 07 24 252 
4. 18 05 10 04 27 18 47 25 16 —.05 00 .20 50 
hs 07 08 ~—.10 09 24 03 .06 06 58 24 —.09 .08 50 
8. .16 29 08 23 12 222 .32 —.08 34 44 03 .09 63 
9 27 13 04 04 28 56 30 o1 19 23 15 .O1 69 
10. .29 09 02 28 27 61 19 —.05 18 27 03 13 78 
19, 05 03 tt —.06 —.08 26 15 48 —.11 {1 03 .10 38 
22. 00 49 27 28 —.07 26 .06 19 09 —.02 20 .08 .56 
25. .39 17 01 10 10 05 21 44. —.18 11 08 18 52 
28, Atl 02 40 —.05 29 16 26 06 18 40 09 .08 .56 
31. At 17 37 29 07 28 04 19 —.07 12 —.08 .02 AL 
32. 2) 25 14 06 15 16 43 04 —.04 O1 —.18 .02 .40 
33. ~—.12 04 —.02 12 20 04 06 —.05 60 O1 —.21 15 51 
35, 02 14 —.17 14 01 —.01 18 —.15 24 —.11 16 22 26 
36. 22 07 29 OL 14 02 —.08 34 05 00 22 05 33 
37. AS 11 20 39 —.03 .07 23 40 00 21 02 17 52 
38. 13 13° —.04 50 40 17 27 00 14 17 05 e2T 67 
44, .19 10 —.0t 24 48 .28 19 23 26 10 10 .06 .59 
45. 18 06 13 38 50 .16 24 00 27 10 —.20 .09 .66 
48, 03 07 13 05 48 25 35 13 14 31 10 13 .60 
52. . 64 12 24 05 02 13 .16 13 —.14 —.04 07 .07 57 
54. 44 12 24. 18 —.05 33 23 24 20 03 17 .16 62 
56, 37 24 46 07 28 22 04 11 —.07 —.02 09 04 57 
57. ~— .04 49 —.02 00 24 17 .07 29 —.03 05 09 .07 43 
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INTERPRETATION OF TITE [*acroRrs 


The factors will be discussed roughly in 
order of the hypotheses listed earlier. The 
interpretations rest principally upon tests 
with factor loadings of .30 or greater. The 
names and numbers of the tests are listed 
preceding the discussion for each factor. 
Following the names of the tests are three 
columns labeled A, B, and C representing 
the three batteries. [‘actor loadings .30 or 
greater are listed opposite the name of the 
test in the column representing the battery 


in which the factor appeared. If a test had 
a loading of .30 or greater on a particular 
factor in one battery and one less than .30 
in another battery on the same factor, both 
loadings are listed. In parentheses are load- 
ings .30 or greater on other factors. A dash 
in the column indicates that the test was 
not in the particular battery. A plus sign 
indicates that the test was in the battery 
but that the factor under discussion did not 
appear in that battery. 

The first two factors to be discussed are 
reference factors. 


Factor A. VERBAL COMPREHENSION (V) 





A B Cc 
49. Verbal Analogies I 49 (.48 CR) 39 (.43 CR) — 
55. Word Classification 42 (.45 VC) 39 (.40 VC) -—- 
26. Matrix Order 42 — — 
21. Inventive Verbal Relations 41 651 CC) .53 (.47 CC) — 
12. Critical Evaluation 39 37 -- 
50. Verbal Analogies Completion 38 (38 CR, .35 CC) .43 (37 CR, 41 CC) — 
52, Verbal Comprehension — 79 64 
54, Vocabulary Completion -— 40 (.44 CC, .41 AF) .44 (0.33 AF) 
36. Remote Verbal Similarities — 32 .22 (34 Re) 
56. Word-Group Naming a 31 (38 VC, .36 NA) .37 (46 NA) 
2. Associations IIT —- 31 (46 AF) 42 (36 AF, 35 Re) 
25. Logical Classification — — 39 (44 Re) 


It was expected that some of the tests 
designed for this study would contain ap- 
preciable amounts of verbal-comprehension 
variance in spite of the fact that an cffort 


Factor B. 


A 


was made to keep to a low vocabulary level. 
The relatively large number of tests in the 
list above indicates that this is the case. 


GENERAL REASONING (GR) 





41. Ship Destination 61 
Letter Series 
Sign Changes II 
27, Number Scries 


37 (.39 SM) 


Ship Destination was put into Battery A 
as a reference test for general reasoning 
which had appeared in all four of the pre- 
vious studies. According to most recent in- 


Al (.36 EP, 40 EC) 


36 (32 EP, .43 SM, .32 SS) o 23 


formation (Kettner, Guilford, & Christen- 
sen, 1956), general reasoning is best defined 
as the ability to comprehend or to structure 
problems in preparation for solving them. 


Facror C. Epuction or PercertuaL ReLations (PR) 





A B C 

13. Figure Analogies 54 58 = 
29, Perceptual Relations Naming 45 (31 EC, .30 CC) .19 639 SR, .34 CC) — 
6, Completion of Figural Changes — .40 (.31 EC) aes = 

17. Figure Matrix 539 55 _ 
14. Figure Analogies Completion 33 (.53 EC) —_ — 
15. Figure Classification — 30 6.37 PC) — 
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This factor is the first in the list of fac- 
tors being studied in this investigation. 
There were three tests listed under Sub- 
hypothesis la (seeing perceptual relations) 
—Figure Analogies, Figure Matrix, and 
Perceptual Relations Naming. All have 
significant loadings on this factor in both 
batteries (except Perceptual Relations 
Naming which has a significant loading 
only in Battery A). For this reason this 
factor is called eduction of perceptual re- 
lations and is defined as the ability to sce 
perceptual relations. 

Three other tests have significant loadings 
on the factor. One of these is [igure 
Analogies Completion. This test probably 
should have been included under Sub- 
hypothesis la, since the examinee must dis- 
cover the relation between two figures be- 
fore he draws a figure that fits the relation. 
As such it is reasonable to expect that a 
portion of the variance of this test would 
be accounted for by a seeing-relations fac- 


tor. Another test loaded on this factor is 
Factor D, 
AU 
30. Picture Classification + 


15. Figure Classification — 
31. Picture-Group Naming — 


This factor is called perceptual classifica- 
tion and is defined as the ability to see 
similarities in perceptual material. It had 
been expected that two of the tests-—Figure 
Classification and l‘igure Matching—under 
Sub-hypothesis 1b(seeing perceptual simi- 
larities), would define the factor if it 
emerged. Figure Matching had low inter- 
correlations with all other tests and as a 
result has no significant loading on any 
factor in this study. Figure Classification 
does have a significant loading on the 
factor. 

Two other tests were listed under Sub- 
hypothesis 1b. They are tests of the type 
that have been called “structural” in this 
project. Structural tests are defined as those 
that involve simple symbols, letters, or 
numbers, The hypothesis that “sceing simi- 


Completion of Figural Changes. It was 
expected that the major portion of the vari- 
ance of this test would be accounted for 
by an eduction-of-correlates factor since 
the relationship is given and the examinee 
has only to draw a figure to fit the relation- 
ship. The final test on this factor is Figure 
Classification which is a “seeing similari- 
ties” test. It is possible that relationships 
between figures have to be taken into ac- 
count in classifying them. 

In both reasoning studies the list of tests 
for eduction of perceptual relations had con- 
tained tests in which secing similarities 
seemed to be the main feature along with 
tests in which sceing relations scemed to be 
the main feature. One hypothesis tested 
in this study was that each of these two 
types of tests would form a factor of its 
own if given a chance. This seems to be 
the case, since Factor C involves secing 
perceptual relations and I’actor D involves 
seeing perceptual similarities. 


PERCEPTUAL CLASSIFICATION (PC) 





B C 
40 ae 
.37 (.30 PR) — 
.33 (.38 NA) + 


laritics” in structural material is the same 
as “seeing similarities” in figural material 
was tested in this study. This hypothesis 
was not substantiated since neither of the 
structural tests has a significant loading 
on the factor. 

The other tests with significant loadings, 
Picture Classification and Picture-Group 
Naming, were expected to have significant 
loadings on I‘actor I*, verbal classification. 
The items in both these tests consist of 
groups of pictures of objects. It was felt 
that seeing similarities in items of this type 
would be more closely related to seeing 
similarities in groups of words than to 
secing similarities in groups of figures. This 
does not scem to be the case. It may be 
that figural propertics help to determine 
classes of the objects in these tests. 
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Factor E, Epuction or ConcrepTuaL RELATIONS (CR) 





A B Cc 
49, Verbal Analogies I 48 (.49 V) 43 (.39 V) — 
50. Verbal Analogies Completion 38 (38 V, .35 CC) — .37 (.43 V, .41 CC) — 
30. Picture Classification 37 24 (.40 PC) — 
51. Verbal Classification -30 (.32 VC) .34 (40 VC) — 


This factor, analogous to Factor C, is in 
the conceptual area and is defined as the 
ability to see relationships in conceptual 
material. The first test in the list above was 
included under Sub-hypothesis 2a (seeing 
conceptual relations). The second test 
probably should have been included under 
that sub-hypothesis since seeing a relation 
should occur before a word is written to fit 
the relation. The other test under Sub- 
hypothesis 2a, Verbal Relations Naming, 
was also expected to have a significant load- 
ing on this factor. An effort was made to 
keep the seeing of the relations as easy as 
possible, however, so that the major portion 
of the variance would be contributed by the 
naming of the relations. A nonsignificant 
loading here indicates that this attempt was 
successful, 

In addition to the two analogy tests there 


is a verbal-classification test with significant 
loadings in both batteries. This situation 
is similar to that in eduction of perceptual 
relations where there is a figural-classifica- 
tion test. Picture Classification also has a 
significant loading on the factor in one of 
the batteries. The fact that this test has 
significant loadings on both a perceptual- 
discovery and a conceptual-discovery factor 
indicates that both properties may be im- 
portant in picture tests. Since Picture 
Classification has a significant loading in 
only one battery, however, this significant 
loading may be due to chance. 

As in the case of Factor C, in spite of the 
fact that classification tests have significant 
loadings on this factor, the definition is re- 
stricted to seeing relationships since secing 
similarities scems to be the unique feature 
of the next factor to be discussed. 


Factor F. VERBAL CLASSIFICATION (VC) 








A B i= Cc 

55. Word Classification 45 (.42 V) 40 (39 V) —_ 
51. Verbal Classification .32 (.30 CR) .40 (.34 CR) — 
+ 


56. Word-Group Naming 


This is the verbal-classification factor 
that corresponds to the perceptual-classifi- 
cation factor. All three tests in the list 
above were listed under Sub-hypothesis 2b 
(secing conceptual similarities). They all 
involve the classification of verbal material. 
Two other tests under Sub-hypothesis 28, 
Picture Classification and Picture-Group 
Naming, have significant loadings on the 
perceptual-classification factor (D) rather 
than on this one. The final test under Hy- 
pothesis 2b, Similarities, was not included 
in cither Battery A or Battery B. 

A factor called verbal classification had 
been found in the evaluation analysis 
(Hertzka et al., 1954) where it was defined 
as the ability to classify verbal material. 


38 (.31 V, 36 NA) 


The two leading tests in the evaluation an- 
alysis were Verbal Classification and Criti- 
cal Evaluation. The two leading tests in 
the present study are Verbal Classification 
and Word Classification. In spite of the 
fact that these tests were included in both 
studies, the factors in the two studies have 
only one test in common, therefore it is 
not known whether the two factors are the 
same or whether they represent two dif- 
ferent factors. If the two factors are dis- 
tinct, the factor found in this study has a 
stronger claim to the name verbal classifica- 
tion, since the tests with significant loadings 
here seem to fit the definition better than 
those with significant loadings in the evalua- 
tion study. 
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Factor G. 
A 


Epuction or Patrerns (EP) 


B G 





Ad 
38 (.33 EC) 
36 (.41 GR, .40 EC) 


5. Circle Reasoning 
24. Letter Triangle 
23. Letter Series 
27. Number Series 


A factor similar to this was found in the 
first reasoning analysis (Green et al., 1953). 
There it was called eduction of conceplual 
patterns and was defined as the ability to 
see rules, principles, or systems. All the 
tests loaded on the factor in this study were 
listed under Sub-hypotheses 3a and 30. 
They all involve seeing rules or principles 
that are more complex than simple rela- 
tions. The answers to the items in the 
Circle Reasoning test involve several con- 
ditions and the items in the other three tests 
consist of double and triple series. By con- 
trast, the items in the trends tests under 
Sub-hypothesis 3c all involve one relation 


Facror H, 


32 (.36 GR, .43 SM, .32 SS) 


that is repeated between succeeding pairs 
of elements. In view of these facts, the 
definition of this factor was changed to the 
ability to see a set of relationships. 

All the tests in the list above can be con- 
sidered to be structural so that this factor 
might be called “eduction of structural re- 
lations.” There were no figural or verbal 
tests in the study similar to these structural 
tests. Thus it is not known whether the 
definition of this factor should be restricted 
to structural tests or not. T*or this reason 
the factor is called simply eduction of 
patterns pending new empirical evidence. 


ISpUCTION OF CORRELATES (EC) 





AL B nents C — 
14. Tigure Analogies Completion .53 (33 PR) —_ — 
11. Correlate Completion I! 42 (.31 CC) +f — 
23. Letter Series 40 (41 GR, .36 EP) — — 
24. Letter Triangle .33 (638 EP) — — 
6. Completion of Figural Changes 31 (.40 PR) -- — 
29, Perceptual Relations Naming 31 (6.45 PR, .30 CC) + — 
40. Seeing ‘Trends HH 31 + — 

The two leading tests here, [igure be most important since it has a significant 


Analogies Completion and Correlate Com- 
pletion IT, were included under Sub-hypoth- 
esis 4a (finding something to fit a given 
perceptual relation). Three other tests were 
listed under this sub-hypothesis. Two of 
these, Completion of Figural Changes and 
Prescribed Relations, are very similar. Both 
involve finding figures to fit a given rela- 
tionship. One is a completion test, however, 
and the other is a multiple-choice test. The 
completion test, Completion of Figural 
Changes, has a significant loading whereas 
the multiple-choice test, Prescribed Rela- 
tions, does not. This is not too surprising 
since completion tests have been prominent 
in relation to this factor and since this fac- 
tor stresses producing something to fit a 
given relation. The last test under Sub- 
hypothesis 4a was I*igure Analogies. The 
sccing-relations aspect of this test seems to 


loading only on eduction of perceptual re- 
lations. 

Two of the other tests in the list, Letter 
Serics and Letter Triangle, are structural 
tests listed in connection with Hypothesis 3, 
which has to do with the eduction of patterns. 
The discovery aspect probably gives them 
a place in the list for Factor G. Jn each 
test the examinee has to show that he 
knows the system by giving other letters to 
extend the system. Letter Series is a com- 
pletion test and, although Letter Triangle 
is a multiple-choice test, the extension prob- 
lem is still an important aspect of the test. 
But the presence of these two tests in the 
list suggests that correlate completion is uot 
only a matter of supplying something to 
complete a relationship; it seems also to be 
a matter of supplying something to complete 
a pattern or set of relationships. 
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The two remaining tests in the list are 
Perceptual Relations Naming and Sccing 
Trends IT. In neither test is there any need 
to complete cither a relationship or a sys- 
tem. It will be noted that these two tests 
were also in Battery B along with Correlate 
Completion II without determining a cor- 
relate-completion factor. This suggests that 
the two tests may not belong in the list for 
Factor H. Reasons for this will be sug- 
gested a little later. 

One of the important reasons for in- 
cluding the eduction-of-correlates factor in 
this study was to sce whether it might be 
replaced by two factors, one perceptual and 
one conceptual. We seem to have an answer 
to this question, for neither of the tests 
affiliated with Sub-hypothesis 45 (finding 
something to fit a conceptual relation) had 
significant loadings on this factor, while 
three of the four tests under Sub-hypothe- 
sis 4a (finding something to fit a perceptual 
relation) had significant loadings. The two 


conceptual tests largely determine [actor 
M in this analysis. 

actor H might be called “eduction of 
perceptual correlates” except for the fact 
that both figural and structural tests are 
loaded on it. For this reason it is best to 
call it simply eduction of correlates, Later 
research may show that it should be re- 
placed by two factors, one for figural 
material and one for structural. 

The presence of the two unexpected 
tests—Seeing Trends II and Perceptual 
Relations Naming—can be accounted for 
logically by reference to the list of tests 
under Factor T, to be discussed next. They 
are both significantly related to the factor 
of eduction of structural relations, along 
with Correlate Completion IT. The latter 
factor did not come out in analysis of 
Battery A, as might well have been the case. 
What probably happened is that it became 
confounded with I‘actor Hin Battery A. 





Factor J. Epuction or STRUCTURAL RELATIONS (SR) 
A B Cc = 
22, Letter Grouping — 56 49 
11. Correlate Completion I + .50 (.44 CC) — 
40. Seeing Trends II + A2 — 
29. Perceptual Relations Naming + 39 (34 CC) — 
57, Word Groups — 38 AD 


All the tests in this list except Perceptual 
Relations Naming are structural tests that 
were scattered among several hypotheses. 
Since we have already seen that Battery B 
yielded a factor of eduction of perceptual 
relations and a factor of eduction of con- 
ceptual relations, since all but one of the 
tests in the list for Factor T are composed 
of letters, and since most tests involve sec- 
ing relations, we are forced to recognize a 
third relations-secing factor and to give it 
an appropriate name—eduction of structural 
relations. “he presence of a figural test in 
the list may reflect the fact that there is 
some correlation between this factor and 
the parallel figural one. 

All is not otherwise satisfactory with the 
picture of Factor I. Two tests—lI.etter 
Grouping and Word Groups—call for the 
secing of similarities rather than for sceing 
relations in the ordinary sense. It is in- 


teresting that these two tests determine a 
doublet factor in analysis of Battery C, 
from which the remaining tests in the list 
for Factor T are missing. There is a possi- 
bility that the factor in Battery C is another 
one, an ability to see classes based upon 
structural material. We have already seen 
that a perceptual-classification factor and 
a verbal-classification factor are distin- 
guished from eduction-of-relations factors 
in Factors D and I’. It may be that there is 
also a structural-classification factor distinct 
from a corresponding eduction of structural 
relations. Tf this is the case, I'actor I in 
Battery B is a confounding of two factors. 
Without further evidence, however, we 
may for the present accept the two factors 
listed under Factor I as being identical. A 
study now under way should determine 
whether there is also a structural-classifica- 
tion factor. 


22 N. W. KETTNER, J. P. GUILFORD, anv P. R. CHRISTENSEN 


Factor J. Sympot MAnipuLcation (SM) 


A 





47, Symbol Manipulation 11.43 
27. Number Scrics 
43, Sign Changes II 


.39 (37 GR) 

Both tests that were included under Sub- 
hypothesis 5a, symbol manipulation, have 
significant loadings on this factor. Thus, 
the factor is defined as the ability to manip- 
ulate symbols. Number Series was not pre- 
dicted to have a significant loading but it 
is quite likely that manipulation of symbols 
is involved in working this test. Numbers, 
of course, are symbols and it appears that 
some trial-and-error manipulation is neces- 
sary before a solution can be reached. 
Trial-and-crror manipulation seems also to 
be a feature of the other two tests with 


43 (.36 GR, .32 EP, .32 SS) oe = 


significant loadings, and the trial-and-error 
aspect probably could be added to the 
definition of the factor. None of the tests 
that were included under Sub-hypothesis 
15 has a significant loading on this factor. 

There is a possibility that this factor is 
the same as the handling-complicated-pro- 
cedures factor found in the general-reason- 
ing study (Kettner et al., 1956) or it may 
be a combination of handling complicated 
procedures and symbol manipulation. An- 
other possibility is that this factor is a 
structural one parallel to logical evaluation. 


Factor K. Symon SusstiruTtion (SS) 





A —e ~ _———— 
42. Sign Changes 65 
18, Form Reasoning 53 


27. Number Scrics 


Sign Changes and ‘orm Reasoning were 
the two tests included under Sub-hypothe- 
sis 5b, symbol substilution, so this factor 
can be defined as the ability to substitute 
symbols quickly. This factor differs from 
the preceding one in that no trial-and-error 
manipulation scems to be necessary. All 
that is required is the ability to substitute 
symbols according to simple, given rules. 

As in the previous factor, Number Scries 
has a significant loading on this factor but 


Factor Lh. 


32 (.36 GR, .32 EP, .43 SM) = = 


here the finding is not so reasonable. One 
possible explanation is that this factor is a 
combination of symbol substitution and 
numerical facility. Both Sign Changes and 
Number Series involve numbers and lorm 
Reasoning generally has had a near-signifi- 
cant loading on numerical facility in pre- 
vious studies. The high loading of orm 
Reasoning argues against the possibility 
that this is entirely a number factor. 


NamING Anstractions (NA) 





31. Picture-Group Naming = 
56. Word-Group Naming si 


A B e 
38 (.33 PC) 37 
36 (31 V, .38 VC) 46 (37 V) 
34 eS 


39, Seeing Trends + 
53. Verbal Relations Naming + 
28. Object Synthesis — 


This appears to be one of the hypothe- 
sized verbalizing factors. The first four 
tests in the list above were included under 
the general Hypothesis 6 (verbalizing 
ability). They call for the naming of 
classes, relations, or trends. The last test 


132 (33 CC) = 
et 40 (.40 SX) 


in the list above, Object Synthesis, calls 
for naming objects that fit certain require- 
ments. On the basis of these considerations 
the factor has been called naming abstrac- 
tions. 
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This factor is similar to one found by 
Adkins and Lyerly (1951), which they 
called concept formation. The first two 
tests in the list above led their list for the 
concept-formation factor. The factor here 
seems to be more restricted than the one 
found by Adkins and Lyerly. All tests on 
naming abstractions are verbal tests except 
Picture-Group Naming while the tests on 
concept formation included perceptual and 
structural tests as well as verbal tests. In 
addition, all tests that have significant load- 
ings here are completion-type tests that re- 


quire verbal answers. In the Adkins’ study, 
both completion and multiple-choice tests 
had significant loadings on concept forma- 
tion. Perhaps a portion of their concept 
formation has been segregated in this study. 

A naming factor was also found by 
Carroll (1941). The leading tests on that 
factor involved speed of naming colors and 
speed of naming forms. It does not seem 
that naming abstractions is sufficiently simi- 
lar to Carroll’s naming factor to be identi- 
fied with it. 





Factor M. Epuction or CoNCEPTUAL CORRELATES (CC) 
AL B _ Cc 
53. Verbal Relations Naming 54 .33 (.32 NA) — 
21. Inventive Verbal Relations 51 (41 V) AT (.83 V) — 
50. Verbal Analogies Completion 35 (.38 V, .38 CR) AL (.43 V, 37 CR) — 
11. Correlate Completion II 31 (42 EC) 44 (50 SR) — 
29, Perceptual Relations Naming 30 45 PR, .31 EC) 34 (.39 SR) — 
= + 


Vocabulary Completion 


The tests with significant loadings on 
this factor are scattered among various 
sub-hypotheses. Since both tests listed 
under Sub-hypothesis 4b (finding some- 
thing to fit a given conceptual relation) 
have significant loadings on this factor, it 
might well be called eduction of conceptual 
correlates. The other tests, however, do not 
seem to fit this interpretation so well. They 
are completion-type tests, but the main task 
in two of them is that of naming an ob- 
served relationship. Onc of these tests is a 
figural test and one other test is a structural 
test. 

One rationalization would be to extend 
the conception of the eduction of conceptual 
correlates to the act of producing words 
that stand for abstract ideas, the ideas being 
given or readily discovered. This conception 
brings us close to the definition of another 


44 (.40 V, 41 AF) 


factor—expressional fluency—which had 
been defined as the ability to put ideas into 
words, at the time this study was conducted. 
More recent information, however, fairly 
well indicates that exrpressional fluency is 
an ability to produce connected discourse ; 
to form sentences with appropriate sentence 
structure. The tests in the list for Factor 
M call for single words as responses, or 
simple phrases, at the most, which fairly 
well eliminates the hypothesis that this is 
the factor of expressional fluency. It seems, 
then, that we have found a conceptual 
factor for the production of correlates, 
parallel to the previously known perceptual 
factor of the same kind. The presence of 
the naming tests may require a somewhat 
broader conception of the factor or it may 
mean some confounding with an unidenti- 
fied factor. 


Factor N. SENSITIVITY TO PROBLEMS (SP) 


B c 





Seeing Problems 
1. Apparatus Test 

37, Seeing Deficiencies 

45. Social Institutions 


.50 (40 Pe) 
45 (.51 Pe) 
39 (.40 Re) 
38 (50 Pe) 
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This factor is called sensitivity to prob- 
lems, which has been defined as the ability 
to sce defects, needs, and deficiencies. All 
tests that were hypothesized to measure 
sensitivily to problems have significant load- 
ings on the factor here, and no other tests 
have significant loadings. These tests all 
involve the seeing of problems of some 
kind. Seeing Problems involves problems 
connected with common objects; Apparatus 
‘Test involves problems with mechanical de- 
vices; Social Institutions involve problems 
with social institutions; and Seeing Defi- 


Facror 0. 


ciencies involves problems with plans or 
activities. 

In the creativity study (Wilson et al., 
1954), only two of these tests, Apparatus 
Test and Social Institutions, were present 
and had significant loadings on sensitivity 
to problems. Thus the factor seemed to be 
rather restricted. It was included in this 
study in order to test its degree of gen- 
erality by adding somewhat different tests. 
I'rom the variety of tests in the list above 
it appears that the factor is more general 
than had been indicated in the previous 
study. 


PENETRATION (Pe) 


B Cc 





1. Apparatus Test — 
45. Social Institutions — 
44, Similarities — 
48. Unusual Uses — 
38. Seeing Problems — 


Since this factor has three tests in com- 
mon with the preceding one, there is some 
difficulty in distinguishing between the two. 
A clue is given, however, by the two tests, 
Unusual Uses and Similarities, which have 
significant loadings on this factor but not 
on the previous one. Neither is strictly 
a seeing-problems test. The Unusual Uses 
test calls for listing unusual uses for a 
common object, and the Similarities test 
calls for naming similarities between com- 
mon objects. 

In the creativity study, Social Institutions 
and Apparatus Test had additional signifi- 
cant loadings on a doublet which was not 
interpreted although it was suggested that 
it might be a trace of a “penetration factor,” 
which had been hypothesized. Tn that study, 
penetration was hypothesized as an ability 
to sce beyond the immediate and the ob- 
vious. 

Three tests—~Apparatus ‘Test, Seeing 
Problems, and Social Institutions—in the 
list above have significant loadings on Iac- 
tor N (seeing problems). lf it can be 
assumed for these three tests that the 
variance for secing immediate or obvious 
problems is accounted for by Factor N, then 


= .51 (.45 SP) 
= .50 (.38 SP) 
48 


- ‘48 (.35 O, 31 SX) 
= 40 (50 SP) 


actor O might well represent the variance 
due to seeing problems that are not so 
immediate or obvious. It is to be expected 
that those individuals who can see beyond 
the immediate and obvious in the Similari- 
ties test, should be able to produce more 
similarities, and should be able to see far- 
fetched uses of objects in the Unusual Uses 
test. 

The definition of this factor comes fairly 
close to Sub-hypothesis 9a (producing re- 
mote responses). It is quite possible that 
this factor corresponds to that sub-hypothe- 
sis (sce discussion under [actor Q). If 
this is so, one question of interest here is 
why the tests under Sub-hypothesis 9a do 
not have significant loadings on this factor. 
One of these tests is Consequences (remote 
score). Perhaps one reason this test does 
not have a significant loading on Factor O 
is that it deals with things that are remote 
in time whereas the tests loaded on l’actor 
O do not. The other three tests under 
Sub-hypothesis 9a were objectively scored 
tests whose items involved remote meanings 
of words. These tests are of a different 
type than those loaded on Factor O. 
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Factor P. AssociATIONAL FLUENCY (AF) 





10. Controlled Associations II — 
2. Associations III — 
54, Vocabulary Completion ican 
3. Associations IV = 


A B Cc 
48 61 
46 (.31 V) 36 (.42 V, .35 Re) 
41 (.40 V, .44 CC) 33 (44 V) 
40 AT 
a8 56 (.30 O) 


9. Controlled Association — 


All tests with significant loadings on this 
factor were listed under the two sub- 
hypotheses under associational fluency. 
They all require the production of words, 
but they vary in several different ways. The 
stimuli are of three different kinds—one 
given word, two given words, or a defini- 
tion. The words to be produced have five 
different restrictions—words synonymous 
with one given word, words synonymous 
with two given words, words fitting given 
definitions, words associated with one given 
word, and words associated with two given 
words. The number of correct responses 
that are possible for each item varies from 
one to many. The number of responses that 
are asked for in each item varies from one 
to twelve. Some of the tests are speed 
tests and the others are relatively more in 
the nature of power tests. None of these 
differences seem to make an appreciable 
difference. The main feature of all these 


tests is the production of words. For this 
reason, the definition of this factor is given 
as the ability to produce words from a re- 
stricted area of meaning. 

A more recent study in the Aptitudes 
Project (Guilford, Kettner, & Christensen, 
1955) included all tests in the list above 
except Controlled Associations IT, In that 
study these tests produced two factors, 
with Associations IV and Controlled Asso- 
ciation leading one factor and with Asso- 
ciations III and Vocabulary Completion 
leading the other factor. The first factor 
was called associational fluency and the 
second one was not identified pending the 
outcome of the present analysis. It can 
now be suggested that the second one 
might have been eduction of conceptual 
correlates, the Vocabulary Completion test 
being in common with Factor M in this 
study. 


actor Q, ORIGINALITY (O) 


B Cc 





4, Cartoons <= 
32 Plot Titles (cleverness) = 
48, Unusual Uses _ 

8. Consequences (remote) —_ 

9. Controlled Association — 


This is the origmality factor that was 
found previously in the creativity study 
where it was defined as the ability to pro- 
duce remote, uncommon, or clever re- 
sponses, These were the three sub-hypothe- 
eses for the originality factor. It was 
expected that this factor might be replaced 
by two or three factors if given the chance. 
Such apparently is not the case. The tests 
in the list above represent all three sub- 
hypotheses. Thus it seems that all three 
properties should be included in the defini- 
tion of the factor. 


= AT 

= 43 

a 35 (.48 Pe, 31 SX) 
=" 32 (34 IF, .41 SX) 
Zs 30 (.56 AF) 


Controlled Association has a significant 
loading on the factor but was not included 
on any of the sub-hypotheses for originality. 
It did have a barely significant loading on 
originality, however, in the creativity study, 
so it is not completely surprising that it has 
a significant loading here. The Quick Re- 
sponse test which was included under Sub- 
hypothesis 9b had a significant loading on 
originality in the creativity study but not 
here. Perhaps this is due to the fact that 
the “uncommonness” key used here was 
not derived from the sample that was tested. 
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Three objectively scored tests were also 
included among the tests for originality— 
Associations ITI, Associations IV, and Re- 
mote Verbal Similarities. None of these 
tests had significant loadings on the factor. 

The two tests under Sub-hypothesis 9c 
(producing clever responses) have the 
highest loadings on this factor. It is possible 
that this factor should be defined as the ability 
to produce clever responses even though tests 
from the other sub-hypotheses have signifi- 
cant loadings here. It is possible to produce 
clever responses for the other tests that 


Facror R, 


have significant loadings on the factor. If 
only the clever responses had been scored 
in these tests, they might have had higher 
loadings than they did. At any rate, it is 
quite possible that those individuals who 
produce clever responses to these tests pro- 
duce a larger number of responses. This 
would explain why tests besides Plot Titles 
(cleverness) and Cartoons had significant 
loadings on the factor even though they do 
not obviously fit the sub-hypothesis ‘“‘pro- 
ducing clever responses,’ and permit the 
defining of originality as “cleverness.” 


REDEFINITION (RE) AND JUDGMENT (J) 





19, Gestalt Transformation ~~ 
25. Logical Classification — 
37. Seeing Deficicncies ~~ 

2. Associations IIL — 
36. Remote Verbal Similarities — 


The two leading tests on this factor were 
among the tests hypothesized to contain 
redefinition variance. Both of these tests 
have had significant loadings on redefinition 
in previous studies. Two other tests, Re- 
mote Verbal Similarities and Seeing Defi- 
ciencies, have had significant loadings on the 
judgment factor in previous studies. As 
stated under the discussion of the hypoth- 
eses for redefinition, tests of both these 
factors have come out together on a single 
factor in several analyses. Since the two 
factors have not appeared separately in the 
same analysis, it is not known whether the 
two factors are distinct. No new light is 
thrown on the situation here except that a 


Factor S,. 


25 AS 

= ‘44. (.39 V) 
= 40 (.39 SP) 
be 35 (.42 V, .36 AP) 


+ 34 
factor similar to the previous ones has 
reappeared. 
Redefinition has been defined as the 


ability to redefine the uses of objects and 
the contents of statements. This definition 
does not fit Tests 36 and 37 very well. 
Judgment was defined in the second reason- 
ing study as the ability to make wise choices 
in a somewhat ambiguous situation where 
it is necessary, in gencral, to make assump- 
tions over and above the facts that are 
given. This definition fits all the tests in 
the list above except Associations IT]. rom 
all the evidence, it appears that this is a 
confounding of two factors that were prob- 
ably confounded once before. 


IDEATIONAL FLUENCY (II) 





33, 
7. Consequences (low quality) 
8. Consequences (remote) 


‘The two leading tests on this factor were 
included in this study as reference tests for 
ideational fluency. This factor was defined 
in the creative-thinking study as the speed 
of calling up ideas in a situation in which 
there is relatively little restriction and qual- 
ity does not matter. Both of the scores for 


Plot Titles (low quality) -- 


— .60 
—- 58 
- 34 (32 O, 41 SX) 


the Consequences test have significant load- 
ings. Evidently the low-quality responses 
were not completely separated from the 
remote responses in the scoring, as is indi- 
cated by the fact that the two scores have 
an intercorrelation of .39. 
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Factor T. SPONTANEOUS FLEXIBILITY (SX) 


B c 





8. Consequences (remote) 
28. Object Synthesis — 
48, Unusual Uses — 


In the creativity study, spontaneous flexi- 
bility was defined as the ability to produce 
a diversity of ideas. In that study both 
Consequences (remote) and Unusual Uses 
had significant loadings. The other test on 
this factor, Object Synthesis, does not fit 
the definition very well since only one 


= AL (32 O, 34 IF) 
a 40 (.40 NA) 
a 131 (.48 Pe, 35 O) 


answer is required for each item. It may 
very well be, however, that having a diver- 
sity of ideas is helpful in arriving at an 
answer to the items in this test. At any 
rate, because of the similarity betwcen this 
factor and the one found in the creativity 
study, it is called spontaneous flexibility. 


Facror U. UNmmentiriep (U) 





A B Cc 
39, Sceing Trends 59 + —_ 
34, Prescribed Relations Al —~ — 


No attempt is made to interpret this 
doublet since the common element of these 
two tests is not obvious. 

The remaining factors in the three bat- 
teries are residuals. None has a loading 
greater than .30 in absolute value. 


LISCUSSLON 


Relations of the Factors to Those in 
Previous Studies 


This study had several aims. One of these was 
the verification of factors found in previous 
studies. Eleven factors were under investigation. 
Five of these had been found in two or more 
siudies in the Aptitudes Project. Four of the five 
appeared in this study in substantially the same 
form as before. These factors are: eduction of 
perceptual relations, eduction of conceptual re- 
lations, eduction of correlates, and redefinition 
(confounded with judgment). 

Five of the six factors that had been found in 
only one study previously were verified. These 
factors are: eduction of patterns, associational 
fluency, originality, sensitivity to problems, and 
verbal classification. 

Facility with verbal relations did not reappear. 
In the evaluation analysis, in which it had been 
previously found, the relatively large and somewhat 
heterogeneous list of tests related to it made inter- 
pretation difficult. Five of the tests related to it 
in the evaluation study and also present in this 
study proved to have significant loadings on verbal 
comprehension, verbal classification, and assocta- 
tional fluency. The first two of these appeared in 
the evaluation study. The inference is that the 


factor called “facility with verbal relations” was 
a composite of associational fluency plus other un- 
identified factors. 

Tests for three reference factors—verbal compre- 
hension, general reasoning, and ideational fiuency— 
were included as marker tests. These three factors 
emerged as expected. Jn addition, the previously 
known factor of spontaneous flexibility emerged 
even though no marker tests were included for it. 

Five new factors were discovered and named: 
perceptual classification, eduction of structural re- 
lations, naming abstractions, eduction of conceptual 
correlates, and penetration. There was some indi- 
cation of another new factor that could be called 
“structural classification,” but it was not clearly to 
be distinguished from the new correlates factor. 
Perhaps it is incorrect to say that the factor of 
penetration is new. Such a factor had been some~- 
what anticipated in ihe creativity study and a 
doublet factor could have been so identified. 


Relation of the Factors to the Hypotheses 


The discussion of this subject will follow fairly 
closely the order of discussion of the hypotheses 
given in the early part of this paper. First, some 
more general questions were asked pertaining to a 
few of the factors, then some specific hypotheses 
were stated pertaining to each factor under investi- 
gation. 

The question of degree of generality was raised 
concerning two of the creative-thinking factors— 
sensitivity to problems and originality. In this 
study, sensitivity to problems appears to be some- 
what more gencral than in the creativity study. It 
pertains to seeing defects or deficiencies in things 
other than mechanical gadgets and social institu- 
tions; more specifically, this extends to familiar, 
nonmechanical objects and to planned operations. 
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As to originality, on the surface it seems that the 
factor is as broadly general as it was before, 
pertaining to the production of unusual, remotely 
connected, or clever responses. The discovery of a 
penetration factor, however, suggests that remote 
associations may be dependent upon a factor other 
than originality or that there are different kinds of 
remoteness involved in tests of these two factors. 

Questions were raised concerning the possible 
identification of two pairs of factors. The first 
pair included associational fluency and facility with 
verbal relations. It was found that the latter factor 
did not emerge, as such, in this study and that 
when previously found it probably represented a 
confounding of associational fluency with other un- 
known factors. The second pair was composed of 
redefinition and judgment. Tests for the two came 
out loaded on the same factor, but owing to the 
lack of traditionally definitive tests for judgment, 
the issue ts still uncertain. 

The general question was raised as to whether 
tests that call for classifying activity or the recog- 
nition of similarities among objects would go into 
the same categories as the tests that call for recog- 
nition of relations between objects. From the 
results of this study we have strong evidence that 
there is a group of factors representing abilitics 
to classify objects separate from the group pre- 
viously known representing abilities to cognize 
relations, There appear to be as many as three 
in each group, having to do with figural, structural, 
and verbal material, respectively.’ 

The introduction of a number of naming tests 
into the study raised the question of whether there 
would be one new factor representing the ability 
to produce names or verbal descriptions for ideas 
or perhaps several new verbalizing factors, or none. 
The results secm to be strongly on the side of the 
hypothesis of one such naming or verbalizing 
ability. It does not seem to matter whether the 
thing to be verbalized is a class or a relation or 
a system, so long as it is an abstraction of some 
kind. 

The fate of the specific hypotheses concerning 
many of the factors may be treated very briefly: 

Eduction of perceptual relations. The main hy- 
pothesis tested was whether sceing relationships 
and seeing classes among figural objects call for 
one primary ability or two. The results indicate 
two separate abilities, the other being called per- 
ceptual classification. 

Eduction of conceptual relations. The hypotheses 
and findings parallel those for the preceding factor. 
There is a factor of verbal classification, found for 
the second time. Although there was no prediction 
of it at the time this study was initiated, there 
emerged a factor that could be identified as “struc- 


8Tt was the results such as these in the present 
investigation that gave the strongest impetus to 
attempts to organize the intellectual factors in a 
system that has been called the “structure of 


intellect” (Guilford: 1956, 1957, 1958). 


tural classification,” but since it was a doublet and 
bore apparent similarity to another structural fac- 
tor, it was not accepted as a demonstrated factor. 

Eduction of conceptual patterns. Tests were 
included to determine whether this ability extended 
to discovering rules and principles, also trends, as 
well as patterns. The answer seems to be that it 
pertains to all but secing trends. Tests of the 
latter type go with tests of seeing relations. A 
trend may be regarded as a linear pattern or a 
succession of examples of the same relationship 
end to end, and hence lacks the complexity that is 
characteristic of tests of this factor, The results 
indicate another kind of conclusion, and that is 
the probable restriction of this ability to per- 
ceptual and structural tests. The qualifying term 
“conceptual” has therefore been dropped from the 
name of the factor. On the basis of other dis- 
tinctions being found between tests of figural and 
structural materials, we may naturally ask the 
question whether there should not be two factors 
in place of the one obtained, and perhaps a third 
pertaining to conceptual materials.® 

Eduction of correlates. The main hypothesis 
tested was whether there would be two factors— 
perceptual and conceptual—to replace the one that 
had been previously found. The results strongly 
favor the distinction between two, the one being 
conceptual, but the other being heavily featured 
by structural (letter) material. This raises the 
question of the existence of a third factor of 
eduction of correlates among figures. 

Symbol manipulation, The answer pertaining to 
this factor is that there are two distinct primary 
abilities, the other being designated as symbol 
substitution. 

Verbalizing ability. The result concerning this 
hypothesis turned out to be one new factor of 
abstraction naming, which pertains to various 
kinds of abstractions, as indicated in the general 
discussion. 

Sensitivity to problems. This factor seems to be 
a little broader than when first discovered, as ex- 
plained in the general discussion. 

Associational fluency, The new, positive infor- 
mation concerning this factor indicates that it can 
be tested by calling for few or many responses to 
stimulus words. The finding of a new factor of 
eduction of conceptual correlates, however, which 
also involves the giving of a meaningful response 
that satisfies a given relationship, calls for some 
kind of discrimination between the two. The best 
basis at present is that the latter factor involves 
one best or most conventional response whercas 
associational fluency involves a variety of responses. 
This kind of discrimination contributed to the 
distinction between “convergent’’ and “divergent” 


® Subsequent to this study, it has been proposed 
that the well-known factor of spatial orientation 
is the parallel, figural eduction of patterns, and that 
general reasoning is the parallel, conceptual educ- 
tion of patterns (Guilford: 1956, 1957). 
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productive thinking, which played an important role 
in the development of the “structure of intellect” 
(Guilford: 1956, 1957). 

Originality. Although, as indicated above, orig- 
inality still seemed to be involved in tests calling 
for uncommon, remotely associated, and clever 
responses, there is some indication that remote 
associations may be also an indicator of the new 
factor of penetration, 

Redefinition. The separability of this factor 
from that of judgment is still an open question. 

Facility with verbal relations. ‘The indications 
are that this factor, which appeared only once 
before, was then a composite. It did not reappear, 
as such. 

Verbal classification. The ability 1o recognize 
classes of things presented verbally was confirmed, 
with the factor supporting the hypothesis of “see- 
ing conceptual similarities.” 


Categories of Factors 


Earlier work in the project, and this particular 
study, recognized the general domains or categorics 
of reasoning, creativity, planning, and evaluation. 
While these categories have had heuristic value, 
it has become rather clear from the results of the 
present investigation that some new categories are 
in order. The category of evaluation is the only 
one that seems to have persistent value. 

There has been increasing recognition that cer- 
tain factors represent abilities to discover informa- 
tion, or to rediscover or recognize it, in the form 
of things, relations between things, classes, patterns 
or systems, and so on. Other factors have been 
distinguished from discovery factors by the fact 
that they involve production of new information 
from given information. They can be called pro- 
duction factors. Within this group a further 
distinction has developed, as suggested above: that 
between convergent thinking and divergent think- 
ing. The former is aimed toward a conventional 
response of some kind while the latter seeks a 
variety of responscs., 

It is possible to give the former, heuristic cate- 
gories more empirical meaning by reference to 
these new factor-category concepts, Reasoning 
may be defined as relational thinking. We cognize 
relations, we tse relations in producing new infor- 
mation, and we evaluate the products of these steps 
in terms of logical consistency. Creative thinking 
seems to depend most directly upon the divergent- 
thinking category of abilities. In a broader sense, 
creative production, as in ordinary problem solving, 
also clearly involves other than divergent-thinking 
operations. 


Improvement of Tests 


The third objective of this study was more 
incidental than the others. Only general implica- 
tions will be given here concerning the kinds of 
improvements that are indicated for tests as a 


consequence of new information. In addition to 
knowledge of the statistical data concerning each 
test we also learn something concerning its facto- 
rial validity; what common factors it measures in 
the population involved and to what extent. We 
thus learn which tests are best for each factor and 
what secondary factor variances to attempt to 
eliminate in future forms of those tests. We 
learn more about the properties of some of the 
factors so that perhaps new and better types of 
tests can be constructed. The results of this in- 
vestigation carried its expected share of such 
implications, 


SUMMARY 


The main purpose of this study was to 
investigate in the same analysis certain fac- 
tors that had been found previously in the 
domains of reasoning, creativity, and evalua- 
tion. Three major objectives were: (a) veri- 
fication of factors found only once or twice 
before, (b) clarification as to their scope 
and properties, and (c) derivation of in- 
formation that would lead to improvement 
of tests measuring these factors. 

Eleven factors were selected for investi- 
gation, excluding those of doubtful nature 
and those needing more intensive study than 
could be given them in such a general sur- 
vey study as this one. General questions 
asked pertained to the possible identity of 
factors found in different studies, to the 
generality or scope of certain factors, and 
to the possibility that some formerly 
apparently unitary factors might be replaced 
each by two. The introduction of a number 
of tests calling for the examinee to name or 
describe relations, classes, or patterns called 
for hypotheses regarding the possible find- 
ing of one or more new verbalizing factors. 
T’or most expected factors alternative hy- 
potheses were stated as to their properties. 

Tifty-seven tests were selected, adapted, 
or constructed to test the hypotheses, with 
some of them being introduced as marker 
tests of reference factors (other than the 
11 being investigated). The twelve-hour 
battery had to be broken up into three par- 
tially overlapping batteries. Each battery 
was administered to a sample of approxi- 
mately 200 air cadets, two in the Air Force 
and one in the Navy. Three factor analyses 
were done by the centroid method followed 
by orthogonal rotations of axes. 
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Twenty psychological factors were inter- 
preted, five of which were reference factors. 
Nine of the 11 factors under investigation 
were found in somewhat the same form as 
before, with some clarification as to their 
unique properties. They are: eduction of 
perceptual relations, eduction of conceptual 
relations, verbal classification, educhon of 
patterns, eduction of correlates, sensitiwity 
to problems, associational fluency, origin- 
ality, and redefinition (probably confounded 
with judgment). Facility with verbal re- 
lations did not reappear, as such, hence it 
was probably previously a composite factor. 
Symbol manipulation appeared but some of 
the symbolic tests determined another fac- 
tor, distinct from it—symbol substitution. 

Five new factors were found: perceptual 
classification (ability to recognize classes of 
figural objects), eduction of structural rela- 
tions (ability to sce relations between struc- 
tural objects, such as groups of letters), 
naming abstractions (ability to name or 
describe abstractions such as classes, rela- 


tions, and patterns), eduction of conceptual 
correlates (ability to supply a response 
when needed to complete a meaningful 
whole), and penetration (ability to see re- 
mote connections or similarities). A doublet 
factor might have been interpreted as 
“structural classification” (an ability to 
recognize classes of structural objects), but 
it could not be clearly distinguished from 
eduction of structural relations. 

A consideration of natural groupings of 
factors suggests that the heuristic categories 
of reasoning and creative thinking would 
be more appropriately replaced by cate- 
gories of discovery, or cognition, and of 
productive thinking. The latter could be 
subdivided into a convergent-thinking and 
a divergent-thinking group. The category 
of evaluation seems to remain useful. 


1° Tn current writings the term “structural” has 
been replaced by “symbolic” and the term “con- 
ceptual” by “semantic” in order to reduce ambigui- 
ties. 
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